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Abstract. - Small world networks interpolate between fully regular and fully random topologies 
and simultaneously exhibit large local clustering as well as short average path length. Small 
world topology has therefore been suggested to support network synchronization. Here we study 
the asymptotic speed of synchronization of coupled oscillators in dependence on the degree of 
randomness of their interaction topology in generalized Watts-Strogatz ensembles. We find that 
networks with fixed in-degree synchronize faster the more random they are, with small worlds 
just appearing as an intermediate case. For any generic network ensemble, if synchronization 
speed is at all extremal at intermediate randomness, it is slowest in the small world regime. This 
phenomenon occurs for various types of oscillators, intrinsic dynamics and coupling schemes. 
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I/"} ■ Synchronization dominates the collective dynamics of simultaneously low average path length. Indeed, several 

£-s many physical and biological systems [TJ[2] . It might be detailed studies support this view by showing that at fixed 

. . both advantageous and desired, for instance in secure com- coupling strength small world networks tend to already 

• ih munication [3], or detrimental and undesired, as during synchronize at lower connectivity than many other classes 

5_j tremor in patients with Parkinson disease or during epilep- of networks [51ll0|; small worlds also more easily exhibit 

■ ■ -tic seizures [1J[5]. Therefore, a broad area of research has self-sustained activity |11| . 

emerged [HrlH], determining under which conditions on the These results suggest some key properties about the 

interaction strengths and topologies coupled units actually topological influence on the network synchronizability, i.e. 

synchronize and when they do not. In a seminal work es- the capability of a network to synchronize at all, but do 

sentially founding the science of complex network theory, not tell much about the speed of synchronization given 

Watts and Strogatz [9] suggested that a small world topol- that a network synchronizes in principle, 

ogy of a network is particularly supportive of synchroniza- For any real syste m, however, it equally matters how 

tion because small worlds exhibit high local clustering and fast the units synchronize or whether the network inter- 
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actions fail to coordinate the units' dynamics on time 
scales relevant to the system's function (or dysfunction), 
cf. |121fl4. 16]. Yet this question is far from being un- 
derstood and currently under active investigation |17H21| . 
In particular it is largely unknown how fast small worlds 
synchronize, an astounding fact given the seminal work 
on small world networks [9] published more than a decade 
ago. 

In this Letter we study the speed of synchronization 
in generalized Watts-Strogatz ensembles and systemati- 
cally compare the small world regime to more regular and 
more random topologies. We find that small worlds syn- 
chronize faster than regular networks but still orders of 
magnitude slower than fully random networks. The ob- 
served increase of synchronization speed with randomness 
might be attributed [9, 18] to the simultaneous decrease 
of the average path length between two units in the net- 
work. We therefore compare ensembles of networks where 
the degree of randomness varies from completely regular to 
completely random such that the average path length stays 
constant. Here we find that networks synchronize slowest 
in the small world regime. Within the entire model class, 
these results hold for any generic ensemble, i.e. synchro- 
nization speed may be intermediate or slowest but is never 
fastest in the small world regime. This phenomenon occurs 
across many distinct systems, including phase oscillators, 
higher-dimensional periodic and chaotic systems coupled 
diffusively as well as neural circuits with inhibitory delayed 
pulse-coupling. 

Consider N Kuramoto oscillators [22] that interact on 
a directed network. The dynamics of phases 6i(t) G S 1 = 
of oscillators i with time t satisfy 

-Oi) for* e {!,...,#}, (1) 



the network dynamics in its simplest setting: we consider 
strongly connected networks with fixed in-degree k and 
homogeneous total input coupling strengths such that full 
synchrony is achieved from sufficiently close initial condi- 
tions for all coupling strengths J > |21j . 

As the synchronous periodic orbit analyzed is isolated 
in state space, the relaxation time continuously changes 
with possible inhomogeneities, so the qualitative results 
obtained below are generic and also hold in the presence 
of small heterogeneities, cf. |15| . 
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where u is the natural frequency of the oscillators, Jy = 
J/k is the coupling strength between two units and k is 
the number of in- links to a unit. To analyze the purely 
topological impact on the synchronization times, we study 



Fig. 1: (color online) Synchronization times @ monotonically 
decrease with randomness in network ensembles with fixed in- 
degree k = 20 (N = 1000 nodes, J — 1, averages (r) over 100 
realizations of networks with random initial condition each; 
synchronization times ranging from (t) = 1.3 (q — > 1) to 
(r) = 1316 (q — > 0); error bars give standard deviation). 
The small world regime [Eq. @, dashed vertical lines indi- 
cate bounds] appears not to be special at all. Inset: Distance d 
to the synchronous state @ decays exponentially with time t 
after short transients for entire range of randomness q G [0, 1]; 
lines provide single realizations for q G {0, 0.008, 0.04, 0.2, 1}. 

To systematically investigate the sychronization process 
in dependence of the topological randomness we first per- 
formed extensive numerical simulations of the collective 
dynamics. We start with regular ring networks where each 
unit receives directed links from its k/2 nearest neighbors 
on both sides. Adapting the standard small world model 
of Watts and Strogatz [5] to directed networks [53] we 
randomly cut the tail of each edge with probability q and 
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rewire it to a randomly selected node (avoiding double 
edges and self- loops). The small world regime is charac- 
terized by a large clustering coefficient (C(q,k)) and a 
small average path lengtljj. (L(q, k)) Here (.) denotes av- 
eraging over network realizations at given q and k. To 
quantitatively fix the small world regime we take 

^ fc)) <0.5 and fe#>0.85 (2) 



1,(0, fc) ' C(0,k) 

throughout this study. The results below are not sensitive 
to a change of these values. Starting each simulation from 
a random initial phase vector drawn from the uniform dis- 
tribution on [0, 7r) shows that synchronization becomes 
an exponential process after some short transients (Fig. [TJ 
inset), for all fractions q £ (0, 1] of randomness. Thus the 
distance 

d(t) = max dist(6»i(£), #.,(£)) (3) 



increase of synchronization speed, but are not at all topo- 
logically optimal regarding their synchronization time. 

This might be expected intuitively, also from studies 
about synchronizability [9, 10J, and one is tempted to 
ascribe faster synchronization to a shorter average path 
length that results from increasing randomness. 

We therefore first systematically studied the synchro- 
nization time for generalized Watts-Strogatz ensembles of 
networks, specified by a function k(q), where the average 
path length (L) is fixed while the degree of randomness q 
varies [ 
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from the synchronous state decays as 



d(t) ~ cxp(-t/r) 



(4) 
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in the long time limit, where dist(f5, 9') is the circular dis- 
tance between the two phases 9 and 9' on S 1 . 

The asymptotic synchronization time t systematically 
depends on the network topology (Fig. [1}: Regular ring 
networks (q — )■ 0) are typically relatively slow to synchro- 
nize. 

We find that increasing randomness q towards the small 
world regime induces shorter and shorter network syn- 
chronization times, with small worlds synchronizing a few 
times faster than regular rings. Further increasing the ran- 
domness q induces even much faster synchronization, with 
fully random networks (q — > 1) synchronizing fastest (two 
orders of magnitude faster than small worlds in our ex- 
amples). Thus in network ensembles with fixed in-degree 
small worlds just occur intermediately during a monotonic 



Fig. 2: (color online) Small worlds exhibit slowest synchro- 
nization in network ensembles with fixed average path length. 
Here N — 1000 and (L) = 4; small-world region @ is located 
between dashed vertical lines. 

We were surprised to find a non-monotonic behavior of 
synchronization time with randomness (Fig. [5]). In partic- 
ular, networks with intermediate randomness in the small 
world regime synchronize slowest. Analytical calculations 
support this view. In the dynamics linearizing ([T]) close to 
the synchronous state (where 0i(t) = 9j(t) =: 9(t)) phase 
perturbations (fi(t) := 6i(i) — 9(t) evolve according to 



d(f 



^ = ^2 Mm fori £{!,..., N}. 



(• r >) 



Here the stability matrix coincides with the graph Lapla- 



1 C(q,k) denotes the actual divided by the possible number of 

directed triangles containing a given node i, averaged over all i. 
2 L(q,k) denotes the length of the shortest directed path between 

a given pair of nodes (i,j), averaged over all (i,j). 



3 We choose an appropriate in-degree k(q) for each given ran- 
domness q from numerically determined calibration curves such that 
(L(q,k(q))) is fixed. 
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cian defined as 



lar in the small world regime. 



A, 



w 



J5i 



(6) 



100 



and 6ij is the Kronecker-delta. Close to every invariant 
trajectory the eigenvalue A2 of the stability matrix A that 
is second largest in real part dominates the asymptotic 
decay; therefore, A2 here determines the asymptotic syn- 
chronization time via r = — P \ ■ This feature was re- 
Re a 2 

cently shown to hold more generally for network systems 
where the stability matrix is not necessarily proportional 
to the graph Laplacian [2 UTTII23] . 

Determining the eigenvalues of the stability matrices of 
networks with fixed average path lengths yields synchro- 
nization time estimates that well agree with those found 
from direct numerical simulations, cf. Fig. [5] This inde- 
pendently confirms that synchronization is indeed slowest 
for small world networks. 

How does synchronization speed vary with randomness 
for more general ensembles k{q)l A systematic study of 
the synchronization time as a function of both in-degree k 
and randomness q (Fig. [3]) reveals an interesting nonlinear 
dependence. Firstly, it confirms that for all networks with 
fixed in-degree k the synchronization time is monotonic 
in the randomness q and the small world regime at inter- 
mediate randomness is not specifically distinguished. Sec- 
ondly, the two-dimensional function (r(g, k)) implies that 
ensembles of networks with fixed path lengths all exhibit a 
non-monotonic behavior of the synchronization time, with 
slowest synchronization for intermediate randomness. 

Thirdly, considering graph ensembles characterized by 
any other smooth function k(q), q S [0,1], shows that 
this is a general phenomenon and the specific choice of an 
ensemble k(q) is not essential. 

In fact, as illustrated in Fig. [3J for any generic network 
ensemble k(q) (including ensembles with fixed in-degree 
and fixed path length as special choice) the synchroniza- 
tion speed {r{q, k(q))) is either intermediate or slowest, 
but never fastest at intermediate randomness, in particu- 
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Fig. 3: (color online) Nonlinear dependence of synchronization 
time on in-degree k and topological randomness q indicates 
that no generic ensemble k(q) exhibits fastest synchronization 
in the small world regime (logarithmic color scale ranging from 
(r) = 4606 (dark red) to (r) = 1.1 (dark blue)). Solid lines 
indicate ensembles of networks with fixed average path length 
from (L) — 3.5 (top) to (L) = 6 (bottom). The small world 
regime © is located between the dashed lines. 

Is this phenomenon restricted to the specific class of Ku- 
ramoto oscillators? To answer this question, we explored 
the synchronization dynamics of various kinds of oscilla- 
tors coupled in different ways, and consistently found qual- 
itatively the same results. Specifically, in networks with 
fixed average path length, synchrony is consistently fast 
for regular rings, fastest for completely random networks, 
and slowest in the intermediate small world regime (Fig. 

SD. 

For instance, we tested networks of diffusively coupled 
three-dimensional Rossler oscillators |T] satisfying 

yi = Xi +ayi, 

ii = b + Zi(xi - c), 



(7) 



for i G {1, ...,N} where J^ = J/k define the diffu- 
sive coupling and the parameters a, b and c determine 
whether the oscillators are intrinsically periodic or intrin- 
sically chaotic. The above phenomenon persists for both 
periodic and chaotic oscillators (Fig. HJ triangles). 
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Moreover, we investigated the collective dynamics of 
pulse-coupled neural oscillators [141125] with membrane po- 
tentials Vi(i) satisfying 

dV, 



N 



™ ™ Kuram. (anal.) 
O Kuram. (simul.) 
periodic Rossler 
A chaotic Rossler 

Pulse (anal 

x Pulse (simul 



(It 



Here, each potential Vj relaxes towards I > 1 and is reset 
to zero whenever it reaches a threshold at unity, 



E 

f 4 




Vj{f 



Vj(t):=0, t i{ 



t, and m 



1. (9) 
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At these times tj >m the neuron sends a pulse that after a 
delay A > changes the potential of post-synaptic neu- 
rons i in an inhibitory (negative) manner. This neural 
system allows analytic computation |18j of an iterative 
map 

N 

nel, (10) 



8 i (nT) = J2 A *M( n ~ 1 ) T ) 

for the perturbations 6i(nT) of spike times close to the 
synchronous orbit of period T = (l/7)ln(l/(l — 7//)). 
For homogeneous coupling (J,j = —J/k for each exist- 
ing connection) the elements of the stability matrix A are 



given by A44 = A A 



(jJ)/(k(Ie-^ A + 7 J)) if there is 



connection from j to i ^ j, An = 1 — kA + for the diago- 
nal elements and Aij = otherwise, cf. [IS]. As for the 
Kuramoto system, the prediction of synchronization times 
based on the eigenvalues of the matrix A well agrees with 
those obtained from direct numerical simulation (Fig. 2] 
crosses and solid line). 

These results confirm that, largely insensitive to the 
type of oscillators (phase, multi-dimensional, neural), 
their intrinsic dynamics (periodic, chaotic) and their cou- 
pling schemes (phase-difference, diffusive, pulse- like), net- 
works with fixed average path length consistently synchro- 
nize slowest in the small world regime at intermediate ran- 
domness. Further numerical analysis (not shown) indi- 
cates that also the entire nonlinear dependence (Fig. [3J 
of the synchronization time on k and q stays qualitatively 
the same for all these different systems. 

Hence, in general small worlds do not synchronize 
fastest. This holds for various oscillator types, intrinsic 



Fig. 4: (color online) Synchronization is slowest in the small 
world regime for various oscillator types and coupling schemes 
(network parameters as in Fig. [2|. Normalized average syn- 
chronization times (t) /t(0) vs. q for Kuramoto, pulse-coupled 
and periodic as well as chaotic Rossler oscillators (network 
topologies as in Fig. [5J). Neurons with delayed pulse-coupling: 
/ = 1.01, 7 — 1, J — —0.2, t — 0.1; Diffusively coupled Rossler 
oscillators: a = 0.2, c = 5.7, periodic: b — 1.7, J = 2, chaotic: 
b — 0.2, J = 6. The synchronization times are determined by 
measuring the distances d — maxj,j{((xt — Xj) 2 + (yt — yj) 2 + 
(zi — Zj) 2 ) } (Rossler), and d = max, \Si\ (pulse-coupled) and 
fitting ©. 

dynamics and coupling schemes: phase oscillators cou- 
pled via phase differences, higher-dimensional periodic and 
chaotic systenrs coupled diffusively as well as neural cir- 
cuits with inhibitory delayed pulse-coupling. In particu- 
lar, small world topologies are not at all special and may 
synchronize orders of magnitude slower than completely 
random networks. So generically the small world regime 
can either exhibit slowest synchronization or just exhibit 
no extremal properties regarding synchronization times. 

This phenomenon is rather unexpected given previous 
results on synchronization and small world topology. For 
instance, the original work by Watts and Strogatz, as well 
as later studies [TllWiT)] , indicate that small world topolo- 
gies support network synchronization, in particular they 
synchronize at weaker coupling strength than analogous, 
appropriately normalized globally coupled systems. 

Apart from small world properties, other topological 
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features such as betweenness centrality, degree heterogene- 
ity or hierarchical organization have been suggested to 
control whether or not a network actually synchronizes 
[26]. Our results now highlight, that the speed of syn- 
chronization may vary several orders of magnitude, even 
if only the disorder in the topology changes. Synchroniza- 
tion speed thus serves as a key dynamic characteristic of 
oscillator networks, because even if a system synchronizes 
in principle, it might not in practice as the time scales 
involved may be much longer than those relevant to the 
system's function. For practical problems in real-world 
networks, such as preventing synchrony in neural circuits 
@], or supporting synchrony in communication systems 
[3], it is thus essential to further systematically investi- 
gate how additional features, such as heterogeneities [2"T] 
or non-standard degree distributions |20| , impact synchro- 
nization speed. 
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